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Specification 

1 . Title of the Invention 

Image Jointing Apparatus 

5 

2. What is claimed is: 

(1) An image jointing apparatus, comprising an image 
input means, an image storage means storing images 
inputted by the image input means and a joint position 

10 alignment means aligning a joint position of inputted 
images, said joint position alignment means identifies 
a joint reference point capable of detecting a 
position from an input image when divided images are 
jointed after an image to be inputted larger than an 

15 entry of the image input means is divided and inputted 
a plurality of times, and incorporates the divided 
images into one image using this joint reference 
point . 

20 (2) The image jointing apparatus according to claim 
1, wherein when an image is divided and inputted in 
such a way that there are overlapping parts, each 
divided image is inputted after a seal in which a mark 
for detecting its position is attached to an 

25 overlapping part of the image to be inputted as a 
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joint: reference point. 

(3) The image jointing apparatus according to claim 
1, wherein when an image is divided and inputted in 

5 such a way that there are overlapping parts, divided 
images are inputted after divided images to be 
inputted are inserted in a container on which a mark 
for detecting a position is attached as a joint 
reference point . 

10 

(4) The image jointing apparatus according to claim 
1, wherein when joint positions of a plurality of 
images divided and inputted in such a way that there 
are overlapping parts, are aligned, a joint area of 

15 a white pixel crossing two images is extracted from 
an overlapping part of the two images, and a joint 
position of the two images is detected in this joint 
area of a white pixel. 

20 (5) The image jointing apparatus according to claim 
1, wherein when joint positions of a plurality of 
images divided and inputted in such a way that there 
are overlapping parts, are aligned, a line with a 
change frequency of a pixel that becomes a minimum and 

25 with a difference between its own change frequency and 
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a change frequency of a pixel on an immediately 
preceding line becomes a minimum, is detected, and the 
immediately preceding part of this line is designated 
as a joint position of the two images. 

5 

(6) The image jointing apparatus according to claim 
1, wherein when joint positions of a plurality of 
images divided and inputted in such a way that there 
are overlapping parts, are aligned, a line with a rate 

10 that is occupied by a white pixel is a maximum and 
with a difference between its own rate and the rate 
of a white pixel on an immediately preceding line 
becomes a maximum, is detected, and the immediately 
preceding part of this line is designated as a joint 

15 position of the two images. 

(7) The image jointing apparatus according to claim 
1, wherein when two consecutive images are jointed, 
black runs are connected without interruption by 

20 matching an end point of a black run existing in a 
first image with an end point of a black run existing 
in a second image are matched at a joint of the two 
images, by referring to the end point existing in the 
first image and by enlarging or reducing the images 

25 in a process area set in the second image. 
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(8) The image jointing apparatus according to claim 
1, wherein when a mark having a point-symmetrical 
outermost part is used as a reference point 
identifying graphics indicating a joint position and 

5 a features point is detected from a mark extracted 
from an input image, a point-symmetrical center is 
detected by extracting the outermost part of the mark. 

(9) The image jointing apparatus according to claim 
10 1, wherein when a mark for distinguishing an image 

from a background of the image is used as a reference 
point identifying graphics indicating a joint position 
and the joint position is detected using a mark 
extracted from an input image, a same pattern as that 
15 of a mark extracted from the first image is extracted 
from the second image by way of pattern matching. 

(10) The image jointing apparatus according to claim 
9, wherein when graphics extracted from an overlapping 

20 part of a symmetrical input image can be distinguished 
from the background and there is not another similar 
form in the overlapping part, a position is aligned 
using the graphics as a mark designating the joint 
position. 



25 
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(11) The image jointing apparatus according to claim 
8, wherein a badge is inserted in the mark having a 
point-symmetrical outermost part. 

5 (12) The image jointing apparatus according to claim 
1, wherein an image input apparatus having an entry 
area a slightly larger than A4 is used, and a regular- 
size image, such as an A3 or A2 image is divided and 
inputted a plurality of times so as to generate an 
10 overlapping part between images . 

3. Detailed Explanation of the Invention 
[Application Field in Industry] 

The present invention relates to an image 

15 jointing apparatus suitable for a case where according 
to an image jointing apparatus, in particular, large- 
size materials, such as one page of a newspaper, A2 
materials, A3 materials, etc., are inputted to a 
small-size image input apparatus, such as an A4 

20 scanner , etc . 

[Prior Art Technology] 

Lately, a document image file system (electronic 
file) using a large-capacity optical disk has 
25 attracted public attention as a new document managing 
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means. The application of this document image file 
system has expanded and the need to file large-size 
materials, such as one page of a newspaper, 
construction drawings, etc., without reduction has 
5 increased. In order to meet this need, a large-size 
image input means, such as an Al scanner, etc., has 
appeared. For the large-size image input means, for 
example, the Al scanner of HITFILE manufacturer (HT- 
4634-11) is used. 

10 

[Problems to be Solved by this Invention] 

A conventional large-size apparatus, such as the 
above-described Al scanner has problems that such an 
apparatus is very expensive and that such an apparatus 

15 requires a large installation space since the size of 
the entry is Al . 

Therefore, an object of the present invention is 
to provide a low-cost image jointing apparatus by 
enabling the input and storage of a large-size image, 

20 such as an Al-size image using a comparatively small- 
size image input apparatus, such as an A4-size 
apparatus, etc. 

In order to input a large-size image using a 
small-size image input apparatus, first, dividing an 

25 image to be inputted into a plurality of partial 
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images, inputting the partial images in order and then 
incorporating the inputted partial images into the 
large-size original image are studied. In this case, 
it is preferable for a large-size original image to 
5 be reproduced with high accuracy and without 
distortion. 

Another object of the present invention is to 
provide an image jointing apparatus for reproducing 
a large-size original image from partial images 
10 divided and inputted with high accuracy. 

[Means for Solving the Problems] 

In order to attain the above-described objects, 
according to the image jointing apparatus of the 

15 present invention, an image to be inputted (original 
image) larger than the entry of an image input means, 
such as a scanner, etc., is divided a plurality of 
times and the divided partial images are inputted 
using the image input means, and the partial images 

20 are incorporated into one image in an image storage 
means (memory), etc., by carrying out position 
alignment using jointing reference point 
identification graphics, such as a mark, etc., for the 
inputted images ( partial images ) . 

25 In order to align the positions of the partial 
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images using a mark, an image to be inputted is 
divided and inputted in such a way that the 
neighborhoods including the mark position are 
overlapped, by attaching a detectable seal indicating 
5 a joint reference point to the overlapping part of the 
image to be inputted or inserting the image to be 
inputted in a container (carrier sheet, pass case, 
etc. ) on which a similar mark is attached. 

In order to align the positions of two images 

10 divided and inputted, a joint position detecting 
method, such as a mark center position detection using 
a structure analysis method, position alignment using 
a pattern matching method, a minimum change line 
detecting method, white maximum line detecting method, 

15 logical sum jointing method, white tracking method, 
enlargement /reduction correcting method, etc., is 
used. 

[Operation] 

20 An operation based on the above-described 

configuration is described below. 

According to the present invention, since an 
original image (image to be inputted) is divided a 
plurality of times, the divided images are inputted 

25 using an image input means having an entry smaller 
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than the size of the original image and the divided 
images are incorporated into one image, for example, 
in an image storage means, large-size image materials 
can be inputted and stored by a low-cost image input 
5 apparatus having an image input means with a small 
entry. 

High-accuracy position alignment can be realized 
for each inputted image by utilizing a mark, an 
original image can be reproduced without distortion 

10 and with accuracy, and the image can be stored by an 
image storage means. 

Furthermore, since any jointed part between 
images is jointed so as to be connected continuously 
without interruption, the quality of a jointed image 

15 does not appear discontinuous when the image is 
visually inspected . 

[ Embodiment ] 

One embodiment of the present invention is 
20 described in detail below with reference to the 
drawings . 

Fig. 1 shows an example configuration of an 
apparatus embodying the present invention. In Fig. 1, 
a keyboard for inputting code data about the position 
25 of an image, the coordinates of a jointing area, etc., 
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is represented by 1, and a CPU (Central Processing 
Unit) is represented by 2, which executes processes, 
such as the control of the entire system, the swelling 
treatment of a black pixel for an image in a memory, 
the detection of a joint position, etc. A scanner 
( image input means ) for inputting an image to be 
processed is represented by 3, and a scanner 
controller for controlling the scanner 3 is 
represented by 4. A display for confirming code data 
inputted from the keyboard 3 is represented by 5, and 
a display controller for controlling the display 5 is 
represented by 6 . An encoding processor for encoding 
an image inputted from the scanner 3 is represented 
by 7, and a decoding processor for decoding the 
encoded image data is represented by 8. A file for 
storing the jointed image data is represented by 9, 
and a file controller for controlling the input/output 
to and from the file 9 of image data is represented 
by 10. A memory (image storage means) is represented 
by 11, which stores the image data inputted from the 
scanner 3 and stores the image data to be processed 
and the process result. 

Next, the flow of the operation in the present 
invention is described using Fig. 2. As shown in Fig. 
3, Fig. 2 is a flowchart showing a process where an 
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image is divided twice, the divided images are 
inputted and the inputted images are jointed. In step 
100, the first image is inputted to the scanner. In 
step 102, a joint reference point is detected from an 
5 input image. A joint position designation mark printed 
on a carrier sheet is extracted as this joint 
reference point, and a features point detected from 
the mark is used. Alternatively, a mark interactively 
attached on the display 5 using a mouse cursor, etc., 

10 is used. In step 104, the direction is changed by 
judging the upside/downside of an input image using 
the joint reference point extracted in step 102, and 
simultaneously the inclination angle of the input 
image is calculated and the inclination is corrected. 

15 For a method for realizing the direction change of the 
input image, a joint reference point is utilized. 
Alternatively, as shown in Fig. 15, a partial image 
81-1 is extracted from an image 80, a recognition 
ratio in the case where the extracted partial image 

20 is character-recognized without any rotation and a 
recognition ratio in the case where a partial image 
81-2 rotated by 180 degrees is character-recognized, 
are compared, and the superiority of the recognition 
ratios is assessed. If the recognition ratio in the 

25 case where the partial image is rotated by 180 
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degrees, is larger, the input image is rotated by 180 
degrees. 

In step 106, the input image with an inclination 
angle that is corrected, is visually inspected for the 
purpose of confirmation using a display. In step 108, 
if a re-input is needed as a result of the inspection, 
the processes in steps 100 through 106 are repeated. 
If the re-input is not needed, in step 110, the second 
image is inputted, and processes in steps 110 through 
118 are executed, as in the case of the first image 
to obtain the second image with an inclination that 
is corrected. In step 120, an image is normalized (the 
size of the image is unified). In step 122, an 
appropriate joint position is detected from the 
overlapping part of two images. In step 124, the joint 
parts are jointed in such a way that the boundary of 
the images does not stand out on the boarder line 
between the two images. In step 126, the two images 
in the memory are incorporated into one image. In step 
128, the jointed image is visually inspected using a 
display (confirmation of joint result). At this time, 
as shown in Fig. 17, the efficiency of the visual 
inspection can be improved by utilizing joint position 
marks 95-1 and 95-2, etc., indicating the boarder line 
between the first input image 93 and the second input 
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image 94 on the display 84. If high accuracy is needed 
for the jointing, the visual inspection can be 
simplified by providing a function to enlarge and 
display the joint part as shown in 96. Memories 11a 
5 and lib are used to store the divided images of each 
original image, and a memory 11c is used to store the 
jointed image. The jointing can be carried out in the 
memory 11a or lib. Marks which become unnecessary 
after the jointing can be deleted and stored in the 

10 memory 11c. 

When an image is inputted to a scanner, a pass 
case or a carrier sheet as shown in Fig. 4 is used. 
The specification of the carrier sheet shown in Fig. 
4 is set for a case where an A3 image is inputted 

15 using an A4 scanner. A mount is represented by 31, and 
a transparent sheet is represented by 33. An image is 
inserted between the mount 31 and the transparent 
sheet 33. An image is inserted using an insertion 
position aim 34 printed on the mount 31 as a 

20 reference, and is fixed by both the mount 31 and the 
transparent sheet 33. Joint position designation marks 
are represented by 32-1 and 32-2, and are printed at 
the left and right ends of the center of the 
transparent sheet 33 . 

25 In Fig. 3, an image to be inputted which is 
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inserted in a carrier sheet, is represented by 20, and 
marks 20-1 and 20-2 in the image to be inputted 20 are 
joint position designation marks. The first image is 
represented by 21, and the second image is represented 
5 by 22. An area overlapping the second image of the 
first image is represented by 21-1, and an area 
overlapping the first image of the second image is 
represented by 22-1. 21-1 and 22-1 are the same in 
size. The non-overlapping areas of the first and 

10 second images are represented by 21-2 and 22-2, 
respectively. An image obtained by jointing the first 
image 21 and the second image 22 is represented by 23. 
An overlapping area between the first image 21 and the 
second image 22 is represented by 23-2. 21-1 and 22-1 

15 have the same size. 

A case where an image is inputted using a carrier 
sheet on which a joint position indication mark is 
printed, is described above. In that case, it is 
sufficient if the joint position indication mark 

20 exists in the overlapping area between the first and 
second images, and, for example, the same effect can 
be obtained by making a seal for a joint position 
designation mark, attaching the seal to the 
overlapping part of an image to be inputted and 

25 inputting the image. 
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Next, a method for interactively indicating a 
joint reference point on a display using a mouse after 
image input is described using Fig. 16. 

A display image at the time of the first image 
5 input is represented by 85, and the first input image 
is represented by 86-4. Marks designating the scope 
of overlapping areas are represented by 86-1 and 86-2, 
and the enlarged drawing of a part 86-3 of the 
overlapping area is shown in 89-1. A user moves a 

10 mouse cursor 89-2 to a position which a user wants to 
designate as a joint reference point in the 
overlapping area while watching the display. If a mark 
adding operation is performed after the mouse cursor 
is moved to a desired position, a joint position 

15 designation mark 90-1 is added to the first input 
image displayed on the display. Although a mark adding 
operation can be performed by pressing a mouse button, 
it can also be performed by inputting a command from 
a keyboard . 

20 A joint position designation 90-2 is also added 

to the second input image by the same operation. The 
joint position designation marks added by the above- 
described operation can be used as joint reference 
points . 

25 Next, the mark detection is described. The mark 
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detection includes the detection of a mark position 
and the extraction of the features of the mark from 
the detected mark position. In the mark position 
detection, a rectangle surrounding black connected 
5 pixels (for example, a small circle) is extracted from 
an area in the image, which is a mark detection 
target, and the position of the rectangle having a 
size corresponding to the mark is detected from the 
extracted rectangle. 
10 For a method for extracting the features of the 

mark from the extracted mark position, a center 
detection using a structure analysis method, pattern 
matching, etc., are used. 

15 (Center detection using structure analysis method) 

The principle of a center detection method using 
a structure analysis is described using Figs. 5A, 5B 
and 5C . 

(1) Distances between the upper/lower vertical and 
20 left/right horizontal outermost lines of the mark and 
the horizontal/vertical sides of the extracted 
rectangle 35 are calculated, and tables of Ph(y), 
Qh(y), Pv(x) and Qv(x) are prepared for each of the 
scattered x and y values. In Figs. 5A, 5B and 5C, only 
25 distances Pv(x) and Qv(x) in the y direction are 
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shown . 

(2) As shown in 36, Qv(x) is inverted and laterally 
shifted t, and Pv(x) - Qv(t - x) is calculated, and 
the frequency distribution 37 is prepared. Here, the 

5 number of cases (number of samples) where all the 
differences Pv - Qv become a specific value is defined 
frequency. For example, when all the differences 
become a specific value for most of the scattered 
values x, the frequency distribution becomes a 
10 distribution having this specific value as a peak 
value. 

(3) The process described in (2) is repeated in the 
range of -sx < t < sx (range of the extracted 
rectangle), and a frequency distribution map is 

15 prepared . 

(4) The same processes as those described in (2) and 
(3) are also applied to Ph - Qh, and a frequency 
distribution map is prepared. 

(5) A point where the frequency becomes a maximum, is 
20 calculated, and is designated as the center position 

of the mark. 

Fig. 6 is a flowchart showing the center 
detection process using a structure analysis method. 
In step 150, projections in the vertical 
25 direction (y direction) are taken. In step 152, an x 




19 

coordinate in which a black pixel is a peak value as 
a result of taking the projections in the vertical 
direction, is calculated. An sx value is determined 
using the calculated x coordinate as a temporary 
5 center of the mark and using the coordinate as a 
reference. In step 154, the distance Pv between the 
upper vertical outermost line (upper representative 
point) of the mark and the horizontal side of the 
extracted rectangle 35 is detected. In the same way, 

10 in step 156, the distance Pv between the lower 
vertical outermost line (lower representative point) 
of the mark and the horizontal side of the extracted 
rectangle 35 is detected. In step 158, the shift 
amount t in the x direction in the case where the 

15 maximum value wmax of the peak value w of a histogram 
indicating the frequency distribution, that is, in the 
case where the peak value of the histogram becomes a 
maximum, is initialized. In step 160, a positional 
parameter i is initialized to -sx. In step 162, a 

20 histogram peak value indicating the frequency 
distribution in a position i is designated to be w. 
In step 164, it is checked whether w is larger than 
wmax. If w is smaller than wmax, processes in steps 
170 and after are executed. If w is larger than wmax, 

25 processes in steps 166 and 168 are executed. In step 
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166, the shift amount i in the x direction in the case 
where the peak value of the histogram becomes a 
maximum, is designated to be t 0 . In step 168, the 
maximum value wmax of the peak value of the histogram 
5 is replaced with the peak value w of the histogram in 
position i. In step 170, the i value is incremented 
by one, and in step 172, it is checked whether the i 
value is larger than sx. If the i value is not larger 
than sx, processes in steps 162 through 170 are 

10 repeated. If the i value is larger than sx, the center 
detection routine is terminated and the peak value of 
the histogram is returned. In the same way, the shift 
amount s 0 in the y direction in the case where the 
frequency of a histogram, which becomes the center in 

15 the y direction, becomes a maximum, can be calculated. 

At this moment, the center coordinates of the mark are 
calculated as follows using shift amounts t 0 and s 0 in 
the x and y directions, respectively, in the case 
where the returned peak value of the histogram 

20 becomes a maximum. 

(cx, cy) = (t 0 /2, s 0 /2) 
Processes, such as the correction of inclination, the 
overlapping of images, etc., can be performed using 
the calculated center coordinates. 



25 
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( Pattern matching ) 

Fig. 7 shows the principle of overlapping images 
by way of pattern matching. An image to be referenced 
is represented by 40, and a matching pattern is 
5 represented by 41. The matching pattern 41 is 
extracted from the image to be referenced 40. In order 
to extract the matching pattern from the image to be 
reference 40, the result of the mark position 
detection is used. A joint position designation mark 

10 is represented by 42. Here, the joint position 
designation mark 42 is assumed to be included in the 
matching pattern 41. An image to be matched is 
represented by 43, and a rectangle to be matched is 
represented by 44. A pattern to be matched is 

15 represented by 45. The pattern to be matched 45 is 
assumed to be included in the pattern to be matched 
44. In the pattern matching shown here, the pattern 
most similar at the time to the matching pattern 41 
is detected, and the coordinates of the joint position 

20 designation mark is detected as a matching coordinate 
position. 

Fig. 8 is a flowchart showing the process of 
pattern matching. In step 200, the maximum value RMAX 
of a parameter indicating the degree of similarity, 
25 that is, a matching coordinate position (wx, wy), is 
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initialized. In step 202, the starting position in the 
y direction of the matching process is initialized, 
and in step 204, the starting position in the x 
direction is initialized. In step 206, the number of 
5 black pixels (number of dots) BB existing in a part 
(see Fig. 7C) with the same size (vertical LYA, 
horizontal LXA) as the matching pattern 41 in which 
the coordinates of the left upper ADA (see Fig. 7A) 
is (x, y), is calculated. In step 208, the logical 

10 product of the matching pattern and the matching 
process rectangle is calculated, and in step 210, the 
matched number of black pixels n is calculated as a 
result of the calculation. In step 212, a parameter 
R « n 2 /BB indicating the degree of similarity between 

15 the matching pattern and the matching process 
rectangle is calculated, and in step 214, it is 
checked whether the parameter R indicating the degree 
of similarity is larger than the maximum value RMAX. 
If the parameter R is larger than the maximum value 

20 RMAX, a process in step 216 is executed. If not, a 
process in step 218 is executed. In step 216, the 
maximum value RMAX of a parameter indicating the 
degree of similarity is designated to be R, and an x 
coordinate and a y coordinate at this time are 

25 designated to be wx and wy, respectively. In step 218, 
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the x value is incremented by one. This is performed 
in order to shift the matching pattern 41 one dot 
( LXA/M if LXA is M-dots long) rightward against the 
rectangle to be matched 44 and in order to perform the 
5 same calculation of R each time. In step 220, it is 
checked whether a process for one line in the 
rectangle to be matched 44 is completed ( the matching 
pattern 41 is shifted to the right end of the image 
to be matched). If the process is not completed, the 

10 processes in steps 206 through 213 are repeated. If 
the process is completed, a process in step 222 is 
executed. In step 222, the y value is incremented by 
one. This is performed in order to shift the matching 
pattern 41 one dot ( LYA/N if LYA is N-dots long) 

15 downward against the rectangle to be matched 44 and 
in order to perform the same calculation of R each 
time. In step 224, it is checked whether the entire 
rectangle to be matched is processed. If the entire 
rectangle is not processed yet, the processes in steps 

20 204 through 222 are repeated. If the entire rectangle 
is processed, processes in steps 226 and after are 
executed. In step 226, the number of black pixels in 
the matching pattern is calculated and is designated 
to be AA. In step 228, the similarity is calculated 

25 using AA and the maximum value RMAX of the parameter 
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indicating the degree of similarity. 
The similarity is calculated as follows. 

Similarity = JRMAX/AA 

In step 230, coordinates (wx, wy) in the case where 
the similarity becomes a maximum, are designated as 
a matching coordinate position, and the pattern 
matching is terminated. 

Although in the preferred embodiment shown in 
Fig. 5, a circle is used for a joint position 
designation mark used in the center detection method, 
this mark is not limited to a circle, and an ellipse 
or square can also be used. It is sufficient if the 
outermost line of a joint position designation mark 
used in the center detection method using a structure 
analysis method is point-symmetrical. For example, 
graphics in which a badge, such as a company badge, 
etc., is inserted in a circle as a design, can be also 
used. A joint position designation mark used in 
pattern matching can be any kind of graphics if it can 
be distinguished from the surrounding background and 
there are no graphics of the same shape in the 
overlapping part. 

For a method for detecting an optimal joint 
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position from the overlapping area of an image, 
minimum change line detection, white maximum line 
detection, white tracking, random jointing, etc., are 
used. Methods for detecting a joint position by way 
5 of minimum change line detection, logical sum jointing 
and white tracking are described below. 

(Minimum change line detection) 

10 The minimum change line detection is described 

using Fig. 9. The overlapping area of two images is 
represented by 50-2, and there are 6 lines in the 
overlapping area 50-2. In this example, since the 
black/white changing frequencies of lines 1 through 

15 6 are 6, 6, 12, 10, 10 and 10, respectively, lines of 
the minimum change frequency are lines 1 and 2. The 
difference in change frequency between lines 1 and 2, 
2 and 3, 3 and 4, 4 and 5, and 5 and 6 are 0, 6, 2, 

0 and 0, respectively. Therefore, since lines with a 
20 change frequency that is a minimum and with a 

difference in change frequency between lines that is 
minimum, are lines 1 and 2, the boundary between lines 

1 and 2 is detected as a joint position. 

Figs. 10A, 10B and 10C are flowcharts showing the 
25 process to detect a minimum change line. In this 
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preferred embodiment, image data are read from the top 
of the overlapping area in means of one byte, black 
/white judgment is performed in means of one dot, the 
change in the number of dots is checked using a black 
pixel detection flag and the change frequency is 
counted. In step 250, both the number of changes and 
a minimum change line position are initialized. In 
step 252, a line position, which is a detection 
target, is designated as the leading line (y = 0) of 
the overlapping area. In step 254, the black pixel 
detection flag is cleared and the pixel change 
frequency is initialized to 0. Bytes to be detected 
are initialized to the leading position (x = 0) of the 
line. In step 256, it is checked whether the black 
pixel detection flag is 1 or 0. If the black pixel 
detection flag is 1, more specifically, if the 
immediately preceding pixel is black, processes in 
steps 258 through 262 are executed. If the black pixel 
detection flag is 0, more specifically, if the 
immediately preceding pixel is white, processes in 
steps 318 and after are executed. First, the case 
where the black pixel detection flag is 1 is 
described. 

In step 258, it is checked whether all pixels in 
the x-th byte of y line are white. If all the pixels 
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are white, processes in step 260 and after are 
executed. If not, processes in steps 278 and after are 
executed. In step 260, the pixel change frequency is 
incremented by one. In step 262, the black pixel 
detection flag is cleared to 0. 

In step 278, it is checked whether all pixels in 
the x-th byte of y line are black. If all the pixels 
are black, in step 314, the black pixel detection flag 
is set to 1. If not, processes in steps 290 and after 
are executed, and black/white judgment is performed 
in means of one pixel. In step 290, the pointer of a 
pixel is initialized, and in step 292, the black/white 
judgment of a pixel pointed to by the pointer is 
performed. If a pixel is white, in step 294, the black 
pixel detection flag is cleared to 0, and in step 298, 
the pixel change frequency is incremented by one. If 
a pixel is black, in step 296, the black pixel 
detection flag is set to 1. In step 300, the pointer 
of the pixel is incremented by one, and in step 302, 
it is checked whether all pixels in the x-th byte of 
y line are processed. If all the pixels are processed, 
the processes in steps 264 and after are executed, and 
the next one byte is processed. If all the pixels are 
not processed, in step 304, it is checked whether the 
black pixel detection flag is 1 . If the flag is 1, the 
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processes in steps 292 "through 302 are repeated. If 
the flag is 0, in step 306, it is checked whether a 
pixel pointed to by the pointer of the pixel is white. 
If the pixel is white, in step 310, the black pixel 
5 detection flag is cleared to 0. If the pixel is black, 
in step 308, the black pixel detection flag is set to 
1, in step 312, the pixel change frequency is 
incremented by one, and the processes in steps 300 and 
after are executed. 

10 If in step 256, the black pixel detection flag 

is 0, processes in steps 318 and after are executed 
as in the case the black pixel detection flag is 1. 

In step 318, it is checked whether all pixels in 
the x-th byte of y line are black. If all the pixels 

15 are black, the pixel change frequency is incremented 
by one (step 320), and the black pixel detection flag 
is set to 1 (step 322). If not, processes in steps 324 
and after are executed. 

Processes in steps 324 through 350 are steps 

20 where black pixels in the processes of steps 278 
through 314 are replaced with white pixels. 

In step 264, the position of a byte to be 
detected is advanced by one, and in step 266, it is 
judged from the position of the byte to be detected 

25 whether a process for one line is completed. If the 
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process is completed, the processes in steps 268 and 
after are executed. If not, the processes in steps 256 
through 264 are repeated. In step 268, it is checked 
whether the pixel change frequency of a line checked 
5 here is larger than the pixel change frequency of a 
line previously checked. If this pixel change 
frequency is smaller than the previous pixel change 
frequency, the processes in steps 270 through 272 are 
executed. If not, the processes in steps 274 and after 

10 are executed. In step 270, the position of the minimum 
change line is designated as the position of the line 
checked here, and in step 272, the minimum pixel 
change frequency is designated as the pixel change 
frequency checked here. In step 274, a line position 

15 to be detected is advanced by one, and in step 276, 
it is checked whether all lines existing in the 
overlapping area were checked. If all the lines are 
checked, the peak value of the histogram is returned 
and the process is terminated. If not, the processes 

20 in steps 254 through 274 are repeated. 

The detection of a minimum change line can be 
detected by the above-described processes. 

(White area maximum position detection) 
25 A method for detecting a line with a white area 
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trhatr is a maximum and jointing images is described 
using Fig. 11. The non-overlapping areas of two images 
are represented by 52-1 and 52-3, and the overlapping 
area of the two images is represented by 52-2. It is 
5 assumed that there are six lines in the overlapping 
area 52-2. Since the numbers of white pixels of lines 
1 through 6 are 8, 9, 11, 13, 10 and 9, respectively, 
a line with the maximum number of white pixels is line 
4. Since the difference in the number of white pixels 

10 between lines 1 and 2, 2 and 3, 3 and 4, 4 and 5, and 
5 and 6 are 1, 2, 2, 3 and 1, respectively, lines with 
the maximum number of white pixels is a maximum and 
between which the difference in the number of white 
pixels is a minimum are lines 3 and 4, the boundary 

15 between lines 3 and 4 is detected as a joint position. 

( White tracking ) 

A method for jointing images by way of white 
tracking is described using Fig. 12. The overlapping 

20 area of the first image is represented by 55, and the 
overlapping area of the second image is represented 
by 56. The overlapping area of an image obtained by 
jointing the two images is represented by 57. The 
joint position of the first image, which is obtained 

25 by tracking and detecting a white area crossing the 
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overlapping area 55 is represented by 58-1, and the 
joint position of the second image, which is obtained 
by tracking and detecting a white area crossing the 
overlapping area 56 is represented by 58-2. If the two 
5 images are jointed, 55 is cut off in the joint 
position 58-1, and an image 55-1 remains. 56 is cut 
off in the joint position 58-2, and an image 56-1 
remains. If the images 55-1 and 56-2 are jointed in 
a position 58-3, the jointed image is 57. The opening 

10 caused due to the mismatching of the joint position 
of the first image 58-1 and the joint position of the 
second image 58-2 in the joint position 58-3 of the 
jointed image 57 is assumed to be white. In this way, 
image distortion, discrepancy, etc., at the time of 

15 the input of two images can be absorbed by tracking 
and jointing the images in a blank part. 

(Logical sum jointing) 

A method for jointing images by way of a logical 

20 sum is described using Fig. 13. The overlapping area 
of the first image is represented by 61, and the 
overlapping area of the second image is represented 
by 62. The overlapping area of an image obtained by 
jointing the two images is represented by 63. An area 

25 obtained by applying a logical sum is represented by 
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64. Here, a logical sum is applied by overlapping two 
dots . 

( Enlargement/reduction correction ) 

A method for smoothly jointing images by applying 
enlargement/reduction correction is described using 
Fig. 14. The first image is represented by 65, and the 
second image is represented by 65. An image obtained 
by jointing the images by way of enlargement/reduction 
correction is represented by 67. Here, a smoothly 
jointed image can be obtained by using the first image 
as a reference image and applying a geometrical 
conversion, such as enlargement, reduction, etc. , to 
an area to be processed which is provided in the 
second image . 

First, the end point of a black pixel (black run) 
is detected, and the end point of the black run of the 
reference image and the end point of the black run in 
an image in the area to be processed are matched. If 
the matching of the end points of all black pixels on 
the boarder line is completed, geometrical conversion 
is applied to the entire area to be processed, based 
on the matching of the end points in such a way that 
the boarder line between the adjacent images may not 
be sensed. 




J 
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Although five joint position detecting methods 
of minimum change line detection, white area maximum 
position detection, white tracking, logical sum 
jointing and enlargement/reduction correction are 
5 described, according to logical sum jointing and white 
tracking, an image process is executed by overlapping 
two images, and according to minimum change line 
detection and enlargement /reduction correction, the 
image process is executed on the boarder line between 
10 two images . 

The methods described above can also be applied, 
for example, to a case where a larger image is 
inputted by dividing the image into four partial 
images . 

15 

(Example of four-division and input) 

Fig. 18 shows a case where an image is divided 
into four partial images and the four partial images 
are inputted into a scanner. An image to be inputted 

20 is represented by 70, and images obtained by dividing 
70 into four partial images are represented by 71-1 
to 71-4. Upper left, upper right, lower left and lower 
right partial images are represented by 71-1, 71-2, 
71-3 and 71-4, respectively, and the sizes of all the 

25 images are the same. Shaded area in Fig. 18 indicates 
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an overlapping area between images. Joint: position 
designation marks are represented by 74-1 to 25. In 
this example, first, image 72-1 is obtained by 
jointing images 71-1 and 71-2 using joint position 
5 designation marks 74-1 and 74-4, and 74-2 and 74-5, 
and image 72-2 is obtained by jointing images 71-3 and 
71-4 using joint position designation marks 74-8 and 
74-11, and 74-9 and 74-12. Then, image 73 is obtained 
by jointing the two images using joint position 
10 designation marks 74-14 and 74-17, and 74-16 and 74- 
19. 

Since the upper/lower and left/right sides of an 
image to be inputted can be identified by changing the 
specification of each joint position designation mark 

15 printed in five places on a carrier sheet, there is 
no need for a user to worry about the input order. 

According to this preferred embodiment, an image 
of a regular size, such as an A3 image, an A2 image, 
etc., can be divided a plurality of times, the divided 

20 partial images can be inputted so as to generate an 
overlapping part between images and the partial images 
can be jointed using an image input apparatus having 
an entry area slightly larger than A4. 

25 [Effect of the Invention] 
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As described in detail above, according to the 
image jointing apparatus of the present invention, 
since image input can be carried out using an image 
input means having an entry smaller than the size of 
the original image by dividing the original image a 
plurality of times and inputting the divided partial 
images, there is no need for a large space in order 
to install image input and storage apparatuses, and 
the cost of the image inputting means can be reduced. 

Since a mark designating a joint reference point 
is attached to the overlapping part of each image when 
the image to be inputted is divided and this mark is 
used when two images are incorporated into one image, 
the high-accuracy position alignment of the two images 
can be realized, and the original image can be 
reproduced and stored without distortion, without 
discrepancy in a joint part and with accuracy. 

4 . Brief Description of the Drawings 

Fig. 1 shows the system configuration of one 
preferred embodiment of a system for realizing the 
present invention. Fig. 2 is a flowchart showing the 
operation procedure of one preferred embodiment of the 
present invention. Fig. 3 shows a system for dividing 
an image into two partial images and inputting the 
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divided partial images. Fig. 4 shows an example 
specification of a carrier sheet. Fig. 5 shows the 
principle of a method for detecting a mark center 
using a structure analysis method. Fig. 6 is a 
5 flowchart showing the procedure of a method for 
detecting a mark center using a structure analysis 
method. Fig. 7 shows the principle of pattern 
matching. Fig. 8 shows the flow of pattern matching. 
Fig. 9 shows a minimum change line. Fig. 10 is a 

10 flowchart showing a minimum line change line detecting 
method. Fig. 11 shows a method for detecting a line 
with a white area that is a maximum and jointing 
images. Fig. 12 shows an image jointing method using 
white tracking. Fig. 13 shows a logical sum jointing 

15 method. Fig. 14 shows an image jointing using an 
enlargement/reduction correcting method. Fig. 15 shows 
a method for modifying the direction of an input 
image. Fig. 16 shows an example method for indicating 
a joint reference point using a mouse. Fig. 17 shows 

20 an example indication of the joint position of two 
jointed images. Fig. 18 shows a preferred embodiment 
of a jointing process in the case where an image is 
divided into four partial images. 

1: Keyboard, 2: CPU, 3: Scanner (Image input 

25 apparatus), 4: Scanner controller, 5: Display, 6: 
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Display controller, 7: Encoding processor, 8: Decoding 
processor, 9: File, 10: File controller, 11a, lib and 
11c: Memory (Image storage apparatus), 20: Image to 
be inputted, 21: The first image (divided image), 22: 
5 The second image ( divided image ) and 23 : Jointed image 

Agent: Kenjiro TAKE, Patent Attorney, etc. 

Fig. 1 

10 1 Keyboard 

3 Scanner 

4 Scanner controller 

5 Display 

6 Display controller 
15 7 Encoding processor 

8 Decoding processor 

9 File 

10 File controller 

1 1 Memory 

20 

Fig. 2 

100 Inputs the first image. 
102 Extracts a joint reference. 
104 Corrects inclination. 
25 Corrects direction. 
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106 Displays an image. 

108 Image OK? 

110 Inputs the second image. 

112 Extracts a joint reference. 

114 Corrects inclination. 

Corrects direction . 

116 Displays an image. 

118 Image OK? 

120 Normalizes an image. 

122 Extracts an optimal joint position. 

124 Corrects distortion. 

126 Joints images. 

128 Image OK? 

1 Start 

2 End 

Fig. 3 

20 Image to be inputted 

21 The first image 

22 The second image 

23 Jointed image 

Fig. 4 

43 A3 image 
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Fig . 5 

1 Distance 

2 Frequency 

Fig . 6 

150 x projection 

152 Calculates the peak value of the x projection. 

154 Detects an upper representative point Pv. 

156 Detects a lower representative point Qv. 

158 Initializes wmax.to. 

162 Representative point in position i and the peak 
value of histogram 

1 Detects center, 

2 Returns . 

Fig. 8 

200 Initializes similarity and maximum similar 
position. 

206 BB = number of black pixels in a rectangle to be 
matched 

208 Logical product of matching pattern and the 

rectangle to be matched 

210 n = number of matched pixels 

226 AA = number of black pixels in the matching 
pattern 
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228 Similarity 

23 Matching coordinate position 

1 Pattern matching 

2 Returns . 

5 

Fig. 9 

1 Overlapping area 

2 Line No . 

3 Change frequency 

10 4 Difference in change frequency 

5 Minimum change line 

6 Image joint position 

Fig. 10A 

15 250 Initializes the number of change points and 

minimum change line position. 

258 The x-th byte of y line =0? 

266 One line completed? 

268 count > number of change points 
20 270 Minimum change line position = y 

272 Number of change points = count 

276 All lines completed? 

1 Detects minimum change line. 

2 Returns . 
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Fig. 10B 

278 The x-th byte of y line = FF? 

292 The n-th bit = 0? 

302 All bits completed? 

Fig. 10C 

318 The x-th byte of y line = FF? 

324 The x-th byte of y line = 0? 

330 The n-th bit = 1? 

340 All bits completed? 

Fig. 11 

1 Overlapping area 

2 Line No. 

3 Number of white pixels 

4 Difference in number of white pixels 

5 Maximum white pixel line 

6 Image joint position 



Fig. 12 
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Joint position overlapping area 



2 



Overlapping area 
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Fig. 13 

1 Overlapping area 
Fig. 14 
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Reference image 
Area to be processed 



15 

No rotation 

Rotates by 180 degrees. 
Character recognition 
Low recognition ratio 
High recognition ratio 

Rotates the entire input image by 180 degrees. 
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Overlapping area mark 
Mark position alignment 
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Displays the first image. 
Displays the second image. 
Joint position mark 
Expands the jointed part. 
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